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ABSTRACT 


Recently,  marine  services  company  Phoenix  International  headed  the  search  efforts  for 
Malaysian  Airlines  flight  370  using  its  Bluefin-21  autonomous  unmanned  underwater 
vehicle  (UUV).  In  total,  it  conducted  270  hours  of  in-water  time  and  covered 
approximately  250  square  miles  of  ocean  floor.  Deploying  multiple  UUVs 
simultaneously  would  have  increased  the  coverage  area  substantially  within  the  same 
time  period.  Ideally,  a  coalition  of  countries  would  be  able  to  jointly  deploy  their 
autonomous  UUVs  with  little  or  no  advance  preparation  since  search  time  is  limited. 
Such  a  task  is  beyond  today’s  capabilities.  Multiple  UUV  coordination  today  relies 
heavily  on  acoustic  communications,  advance  preparation  and  manual  guidance.  This 
thesis  explores  the  application  of  static  analysis  to  allow  multiple  UUVs  to  be  deployed 
simultaneously  with  little  advance  preparation  and  no  acoustic  communications. 
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I.  INTRODUCTION 


Recently,  marine  services  company  Phoenix  International  headed  the  search 
efforts  for  Malaysian  Airlines  Flight  370  in  the  Indian  Ocean  with  its  Bluefin-21 
autonomous  unmanned  underwater  vehicle  (UUV).  Traditional  submarine  support  for  this 
sort  of  mission  would  be  helpful,  but  is  not  economical.  The  Bluefin-21  UUV  can  operate 
at  far  less  cost  than  a  submarine  and  cover  just  as  much  area.  According  to  [1],  it  covered 
approximately  250  square  miles  during  the  search.  Its  primary  drawback,  however,  is  the 
time  it  takes  to  cover  such  a  large  area.  If  the  Navy  could  deploy  multiple  UUVs 
simultaneously,  then  the  coverage  area  would  increase  substantially  within  the  same  time 
frame.  Moreover,  we  would  like  UUVs  to  operate  autonomously,  since  navigating  them 
manually  usually  requires  additional  resources,  like  a  vessel  at  sea.  Though  autonomous, 
UUVs  must  operate  as  a  team  [2]. 

The  basic  problem  this  thesis  addresses  is  how  to  coordinate  multiple  UUVs  in 
the  context  of  a  rapid  deployment  in  which  the  UUVs  come  from  different  vendors — and 
are  thus  unlikely  to  communicate  with  each  other — and  there  is  little  if  any  time  for  UUV 
preparation  or  planning  before  deployment.  These  circumstances  could  arise,  for 
instance,  if  a  coalition  of  countries  rapidly  marshalled  their  UUV  resources  to  search  for 
a  downed  airliner.  Our  approach  to  solving  the  problem  is  novel.  It  is  based  on  analyzing 
by  computer  static  descriptions  of  the  executable  navigation  plans  of  UUVs  and  deciding 
in  advance  of  deployment  whether  any  plans  conflict.  We  say  two  UUVs  conflict  if  there 
is  risk  of  collision  or  if  one  can  pass  the  other  in  a  way  that  interferes  with  operation,  like 
generating  too  much  noise. 

A,  NEAR-TERM  APPLICATIONS  OF  UUVS 

UUVs  are  attractive  in  that  they  can  eliminate  the  threat  to  humans  working  on  or 
under  water.  An  example  would  be  mine  hunting,  an  operation  in  which  deploying 
several  UUVs  would  eliminate  risk  to  human  life  and  perform  the  tasks  as  required. 
Aside  from  search  missions,  persistent  presence  on  station  provides  accurate  and 
consistent  data  collection  in  all  ocean  environments,  supporting  real-time  operations  as 
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well  as  intelligence  preparation  of  the  battle  space  for  expected  operations.  The  Navy 
UUV  Master  Plan  [2]  identifies  several  other  key  intended  uses  for  UUVs  and  highlights 
their  importance  and  integration  into  the  fleet  as  a  valuable  asset.  The  image  in  Figure  1 
depicts  the  Navy’s  vision  for  UUV  integration  into  the  fleet. 


UUVMP  Vision... 

...attack  today’s  littoral  coverage  problem 
and  tomorrow’s  advanced  threat 


Broad  area  denial  Is  a  real  threat  given  technology  trends.  Undersea  systems  may  be  the  only  “undenied" 
force  early.  Unmanned  Undersea  Vehicles  provide  the  Force  Multiplication  needed  to  gain  access  early. 


Figure  1 .  Expanding  the  Role  of  UUVs  to  Meet  the  Navy’s  Mission,  from  [2] 


Of  great  interest  is  the  ability  for  UUVs  to  conduct  intelligence,  surveillance  and 
reconnaissance  (ISR)  missions,  provided  the  communications  piece  is  realized.  Their 
ability  to  remain  on  station  for  extended  periods — on  the  order  of  months — is  extremely 
valuable  in  terms  of  data  collection  and  would  make  them  a  valuable  asset  to  the  Navy’s 
mission. 

Communication  nodes  and  navigation  network  nodes  support  the  critical 

communications  link  between  subsurface,  surface,  land  and  air  assets.  UUVs  could 
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potentially  traverse  areas  unnavigable  by  eonventional  methods,  allowing  for  undersea 
networking  and  elose  ashore  surveillanee.  That  data  eould  then  be  relayed  baek  to  the 
host  ship.  Although  it  is  not  a  primary  mission  of  UUVs,  their  ability  to  act  as 
communications  relay  nodes  could  eliminate  limitations  in  over-the-horizon 
communications.  Future  uses  include  large  networks  spanning  all  dimensions  of  warfare 
(subsurface,  surface,  land  and  air)  providing  complete  battlespace  awareness  that  exceeds 
current  capabilities. 

UUVs  could  provide  advanced  sanitization  of  waterways  intended  for  safe 
operation  and  transit  of  critical  assets  such  as  the  carrier  strike  group  (CSG)  (e.g., 
entrance  to  the  Strait  of  Hormuz).  Warships  inherently  operate  with  additional  risk  and, 
in  the  case  of  a  carrier,  present  a  large  target  for  adversaries.  Warships  transiting  a  choke 
point  are  at  much  higher  risk  than  in  open  water.  Ideally,  the  theater  combined  task  force 
(CTF)  would  task  submarine  support  to  patrol  the  waterways  and  the  choke  point 
entrance  prior  to  the  CSG  transit;  however,  submarines  are  not  always  available  for 
tasking  by  the  theater  CTF,  as  national  tasking  generally  takes  precedence.  If  they  happen 
to  be  available,  the  window  is  generally  very  small  and  the  collected  data  becomes  old 
and  unusable  quickly.  A  more  persistent  presence  by  UUVs  could  mitigate  this  problem 
entirely,  providing  data  to  the  CSG  before,  during  and  after  the  transit. 

UUVs  utilized  as  mine  countermeasures  eliminate  the  risk  to  human  life  and 
enable  the  Navy  to  continue  power  projection  ashore,  in  contested  waters,  and  against 
increasingly  belligerent  adversaries.  Mines  present  a  large  risk  to  manned  vessels  and  are 
of  significant  concern  for  many  reasons,  but,  strategically  speaking,  can  deny  access  to 
enemy  waters.  The  Navy  operates  on  power  projection  and  presence  throughout  the 
world  in  all  waters  navigable.  If  an  adversary  were  to  deny  access  to  their  waters  by  way 
of  mining,  this  would  present  a  serious  challenge  to  naval  forces.  UUV  operations  in 
mine  countermeasure  warfare  are  probably  one  of  the  most  effective  uses  of  these 
vehicles  in  their  current  form;  however,  this  does  not  necessarily  scale  well,  since  there  is 
no  effective  way  to  deploy  multiple  UUVs  operating  in  relatively  close  proximity  without 
risk  of  collision  or  interference. 
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UUV  deployment  in  an  antisubmarine  warfare  (ASW)  eapaeity  eliminates  the  risk 
to  human  life,  has  the  potential  to  eolleet  eritieal  operating  data  on  the  adversary’s  forees 
and  their  movement,  and  ean  deliver  the  data  to  friendly  forees  in  a  timely  manner.  The 
potential  for  offensive  payload  delivery  in  the  ASW  realm  exists  as  well,  although  it  is  a 
difficult  concept  to  implement  due  to  restrictions  in  the  Navy’s  rules  of  engagement 
(ROE).  Underwater  gliders  based  on  buoyancy  engines  to  provide  propulsion  are 
relatively  quiet  in  the  water  and  difficult  to  detect  by  submarine  sonar  systems. 
Deployment  of  these  types  of  UUVs  in  an  ASW  capacity  would  provide  significant 
support  to  conventional  forces  operating  in  contested  waters. 

B,  AUTONOMOUS  JOINT  UUV  OPERATION 

The  applications  of  UUVs  discussed  so  far  could  be  carried  out  through  remote 
manual  control.  In  the  long  term,  UUVs  are  expected  to  operate  autonomously,  meaning 
without  manual  control.  Moreover,  they  are  expected  to  be  deployed  jointly  to  form  a 
team  of  autonomous  vehicles  working  on  a  common  task.  These  two  added  dimensions 
pave  the  way  for  more  cost-effective  ways  to  search  for  undersea  threats  and  support 
civilian  use  cases  like  searching  for  downed  aircraft.  However,  autonomous  multi-UUV 
coordination  is  challenging  for  many  reasons.  We  outline  the  major  ones  here. 

1.  Sound  Propagation  in  Water 

Communication  is  very  constrained  under  water  due  to  limits  of  sound 
propagation.  Underwater  communications  are  highly  dependent  on  environment  variables 
(e.g.,  temperature,  depth,  salinity  and  weather)  and  have  a  limited  range.  The  image  in 
Figure  2  depicts  sound  propagation  in  a  typical  underwater  environment.  Although  there 
has  been  research  in  establishing  underwater  communications,  as  demonstrated  in  [3], 
[4],  [5]  and  [6],  these  communications  are  severely  limited  by  the  propagation  of  sound  in 
water. 
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Figure  2.  Sound  Propagation  in  a  Typical  Underwater  Environment,  from  [7] 


Current  acoustic  modems,  such  as  the  Teledyne  Benthos  900  series  commonly 
used  in  UUV  applications,  are  limited  to  a  range  of  2  to  6  km,  depending  on  the 
environment.  Underwater  sound  propagation  is  dependent  on  losses  that  are  both  range 
and  frequency  dependent,  according  to  Burrowes  et  al.  [7].  Constraints  include  high 
latency  with  acoustic  signal  propagation  through  water — roughly  200,000  times  slower 
than  that  of  signal  propagation  in  air — and  signal  fade  due  to  absorption  and  multipath. 
Higher  frequencies  would  mitigate  some  of  the  ambient  noise  issues;  however,  this  would 
affect  range,  as  higher  frequencies  fade  more  quickly  and  require  more  power. 

2,  UUV  Power  Supply 

Another  inherent  constraint  of  UUV  operations  is  battery  capacity.  This  requires 
the  Navy  to  consider  the  type  and  number  of  sensors  installed  for  a  particular  mission  and 
its  duration,  since  different  sensors  have  different  power  requirements.  Although  higher 
frequencies  would  help  mitigate  the  ambient  noise,  it  requires  more  power  to  transmit  and 
for  the  transmitter  and  receiver  to  be  closer.  The  higher  frequencies  are  also  more 
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vulnerable  to  absorption  and  attenuation,  thus  redueing  propagation.  This  is  not  an  issue 
if  the  mission  duration  is  relatively  short;  regardless,  power  consumption  should  always 
be  a  consideration  in  UUV  design. 

3,  Bandwidth  Constraints 

Another  constraint  of  operating  in  water  is  limited  bandwidth.  Current  rates 
among  commercially  available  acoustic  modems  produce  around  360  bits-per-second 
(bps),  with  an  error  rate  highly  dependent  on  the  signal-to-noise  ratio.  For  a  real-world 
comparison,  a  typical  4G  connected  mobile  device  can  observe  speeds  between  5  to  12 
megabits-per-second  (Mbps),  which  is  roughly  20,000  to  30,000  times  faster  than  the 
speeds  capable  in  water.  This  limits  the  amount  and  type  of  data  that  UUVs  can  transmit 
between  one  another  and  requires  complex  signal  processing  and  error  correction  after 
receiving  the  transmission. 

4.  Joint  Navigation 

Each  UUV  is  programmed  for  a  maneuver.  Coordinating  multiple  UUVs  for  joint 
operation  requires  manually  ensuring  that  each  maneuver,  as  codified  by  an  executable 
program  for  navigation,  doesn’t  interfere  with  another  UUV’s  programmed  movement. 
This  might  be  established  by  showing  disjoint  paths  or  steps  that  each  UUV  takes  to 
avoid  collisions,  in  the  event  that  they  can  communicate  during  the  operation.  As  this  is  a 
manual  process,  it  does  not  scale  to  large  deployments  and  there  is  no  guarantee  that  all 
potential  interference  will  be  detected,  since  the  process  is  very  prone  to  human  error. 
Programs  are  typically  expressed  in  code  like  C++,  which  makes  analysis  difficult. 

C.  AUTOMATED  SUPPORT  FOR  RAPID  JOINT  OPERATION 

Our  approach  envisions  each  UUV  operator  constructing  a  plan  for  that  UUV’s 
underwater  operation.  A  plan  controls  a  UUV  based  on  inputs  such  as  GPS  waypoints 
and  course/speed  definitions.  It  allows  extended  operation,  including  object  avoidance 
capabilities.  The  plans  are  codified  in  a  way  that  a  computer  can  automatically  detect  any 
conflicts  that  exist  before  UUVs  are  deployed. 
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1,  Sampling  Rates 

The  key  observation  is  that  if  multiple  UUVs  sample  their  locations  at  the  same 
rate,  then  under  predictable  operating  conditions,  their  plans  can  be  compared  for  conflict 
in  advance  and  if  none  is  found,  deployed  according  to  their  individual  plans.  Further,  if  a 
conflict  is  detected,  our  approach  will  indicate  where  and  when  in  their  combined 
operation  it  would  occur.  This  gives  operators  insight  into  how  the  conflict  might  be 
resolved,  for  example,  by  changing  the  speed  of  one  UUV. 

The  ideal  use  case  for  our  approach  is  multi-UUV  deployment  by  a  coalition  in 
which  rapid  deployment  is  needed  (e.g.,  a  downed  airliner)  with  no  advanced  preparation. 
Plans  for  UUVs  participating  in  the  coalition  must  not  conflict. 

2,  Limitations  of  the  Approach 

There  is  no  real-time  communications  link  between  UUVs  or  to  a  mother  ship. 
The  goal  is  to  deploy  multiple  UUVs  jointly  and  guarantee  a  priori  that  a  conflict  does 
not  exist.  UUVs  do  not  communicate  once  deployed.  However,  in  the  case  of 
unpredictable  operating  environments,  some  communications  may  be  advisable  in  order 
to  handle  those  situations  in  which  a  UUV  must  recover  from  an  event  it  did  not  account 
for  in  its  plan. 

This  approach  will  not  factor  in  depth  when  considering  possible  collision 
scenarios.  While  two  UUVs  can  share  the  same  space  in  terms  of  three  dimensions,  for 
the  purposes  of  this  thesis,  only  a  two  dimensional  layout  is  considered.  This  limits  all 
UUVs  to  operate  at  the  same  depth  when  using  our  approach.  There’s  nothing  inherently 
difficult  in  treating  depth  as  well;  however,  for  this  thesis,  only  two  dimensions  were 
considered  during  calculations.  Implementation  of  the  third  dimension  is  discussed  in 
Chapter  V. 

This  approach  is  based  on  statically  analyzing  navigation  plans  of  UUVs.  These 

plans  are  constructed  according  to  the  capabilities  of  a  UUV  operating  at  a  certain  speed, 

depth  and  initial  direction  under  predictable  operating  conditions.  Thus,  any  conclusions 

with  regard  to  conflicts  in  the  future  based  on  them  will  only  be  as  accurate  as  these 

parameters  remain  constant.  Changes,  for  example,  in  UUV  speed  or  direction  induced 
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by  the  environment  during  operation  and  not  considered  in  a  navigation  plan  make 
obsolete  any  type  of  static  analysis  done  a  priori. 

Our  approach  assumes  that  every  UUV  when  operating  jointly  operates  at  a 
constant  velocity.  A  UUV  may  change  its  direction  but  not  its  speed.  This  is  a  tradeoff  for 
being  able  to  detect  conflicts  in  advance  while  not  requiring  any  communication  between 
UUVs  during  their  joint  operation.  An  approach  to  allowing  for  planned  changes  in  speed 
is  discussed  in  Chapter  V. 

Minimum  UUV  navigation  capabilities  include,  but  are  not  limited  to,  a  GPS 
transponder  and  a  dead-reckoning  ability.  For  this  thesis,  a  generic,  buoyancy-engine- 
based  UUV  was  assumed  for  modeling  and  simulation.  Accuracy  in  location  is  dependent 
on  user-specified  GPS-fix  intervals.  During  each  fix  the  glider  will  reorient  itself  and 
attempt  to  either  maintain  or  regain  intended  track. 

D,  ROADMAP 

The  remainder  of  this  thesis  is  organized  as  follows.  The  static  analysis  of 
executable  navigation  plans  calls  for  representing  these  plans  in  a  way  that  a  computer 
can  reason  about  automatically.  That  means  plans  cannot  be  expressed  in  languages  like 
C++.  Instead,  plans  are  expressed  as  finite-state  machines  known  as  Moore  automata.  A 
definition  of  Moore  automata  is  given  in  Chapter  II.  Combining  Moore  automata  for  the 
purpose  of  detecting  conflicts  between  plans  calls  for  a  new  form  of  product  construction 
for  automata,  which  is  also  defined  in  Chapter  II.  The  techniques  described  in  Chapter  II 
are  then  applied  to  three  separate  multi-UUV  deployment  scenarios  in  Chapter  III.  The 
first  scenario  shows  two  UUVs  traveling  at  the  same  speed  on  different  plans  with  no 
conflict  between  them.  The  second  scenario  builds  on  the  first  by  introducing  different 
operating  speeds  for  each  UUV  and  more  complex  plans.  This  results  in  more  complex 
Moore  machines.  The  third  scenario  illustrates  a  conflict.  For  this  scenario,  the  plans 
result  in  Moore  machines  with  many  states.  Only  a  portion  of  each  machine  is  shown.  A 
survey  of  related  work  in  Chapter  IV  provides  a  review  of  the  state  of  the  art  of  multi- 
UUV  operations  today.  On  the  surface,  the  work  appears  related,  however,  upon  closer 
examination,  it  is  not.  Conclusions  and  future  work  are  discussed  in  Chapter  V. 
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II.  FINITE-STATE  MACHINES,  MOORE  AUTOMATA 


In  order  to  statically  analyze  the  specification  of  a  UUV  maneuver,  the  maneuver 
has  to  be  expressed  in  a  way  that  is  amenable  to  analysis.  Conventional  programming 
languages  like  C++  are  far  too  expressive  to  be  able  to  reason  about  their  programs  using 
a  computer  alone.  Most  questions  about  the  behaviors  of  such  programs  are  Turing 
undecidable.  So  we  seek  a  notation  whose  programs  can  be  analyzed.  To  this  end,  we 
adopt  a  type  of  finite-state  machine  called  a  Moore  automaton. 

A,  MOORE  AUTOMATA 

A  Moore  automaton  is  a  finite-state  machine  with  output.  More  precisely,  it  is  a 
tupleM  =  A,<^,/l,s)  where 

•  Q  is  a  finite  set  of  states, 

•  Z!  is  a  finite  input  alphabet, 

•  ^:2xE->2is  the  transition  function.  If  M  is  in  state  q  scanning  input  a, 
it  moves  to  state  S(q,a) 
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•  s  defines  the  start  state, 

•  A  is  a  finite  output  alphabet,  and 

•  I  maps  C  to  A  giving  the  output  associated  with  each  state. 

For  example,  a  Moore  automaton  M  that  accepts  precisely  binary  strings  having 
01  as  a  substring  is  given  by  [Q,Jl,A,S,A,sj  where 

Q  =  {qo,q„q2} 

Z  =  {0,1} 

A  =  {0,1} 

s  =  q. 
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the  transition  function  S  is  defined  by 

<^A(^o>0)  =  qi  Sjq„l)  =  qo 
<^A(qi,0)  =  q^  S^(qi,l)  =  q2 

<^A(q2^)^q2 

and  the  output  function  I  is  defined  by 
^(^o)  =  0 

The  output  for  states  ^0  and  ^1  is  0  and  for  q2  is  1.  For  this  particular  Moore 
machine,  the  output  function  is  a  predicate.  In  general,  it  need  not  be.  After  running  on 
some  input,  M  rests  in  a  state  for  which  X  is  true  if  and  only  if  the  input  contains  01  as  a 
substring.  Figure  3  illustrates  an  alternative  way  of  expressing  M  as  a  state  transition 
diagram.  Each  edge  is  labeled  with  an  input  symbol  and  every  state  is  labeled  with  its 
name  followed  by  the  output  for  that  state. 


A  run  of  Mon  binary  string  1 110000101  is  shown  in  Table  1.  The  first  row  shows 
the  input  string,  the  second  row  shows  what  state  M  is  in  based  on  the  input  string 
processed  thus  far,  and  the  third  row  shows  the  output  produced  by  each  state. 
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Table  1 .  Example  Moore  Automaton  Output 


String 

1 

1 

1 

0 

0 

0 

0 

1 

0 

1 

State 

Po 

qo 

qo 

qi 

qi 

qi 

qi 

q2 

q2 

q2 

Output 

0 

0 

0 

0 

0 

0 

0 

1 

1 

1 

B,  UUV  PLANS  AS  MOORE  AUTOMATA 

How  is  a  UUV  plan  expressed  as  Moore  automaton?  The  input  alphabet  beeomes 
coordinates  such  as  latitude  and  longitude.  The  output  alphabet  becomes  operating 
instructions  of  the  UUV  such  as  acceleration  and  turning.  Lastly,  transitioning  from  a 
state  ^  to  a  state  q'  on  coordinate  c  occurs  if  while  in  state  q,  the  UUV  samples  its 
location  and  finds  it  is  described  by  c  to  within  some  tolerance. 

For  example,  Figure  4  illustrates  a  simple  UUV  plan.  The  UUV  starts  at  position 
(0,  3)  and  ends  at  position  (3,  0).  It  has  instructions  to  turn  soft  left,  which  it  does  at  (2, 
1),  and  hard  right,  which  it  does  at  (3,  1).  These  Cartesian  coordinates  (locations)  become 
inputs  to  a  Moore  machine,  while  the  instructions  become  outputs  of  the  machine  that  the 
UUV  must  execute. 
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Figure  4.  Example  UUV  Plan 


A  complete  definition  of  the  Moore  machine  for  this  UUV’s  plan  is 

M  =  {Q,1:,K5A,s) 

Z  =  {(0,3), (1,2), (2,1), (3,1), (3,0)} 

A  =  [acc,idle,tsl,tr] 

s  =  qo 

the  transition  function  S  is  defined  by 
=qi 

5[q„{2,\))  =q^ 
d(q^,{3,\))  =q^ 

^(^3, (3,0))  =q^ 

^(^4, (3,0)) 

and  the  output  function  I  is  defined  by 
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/1(^q)  =  acc 
=nil 

/I  (^2) 

>1(^3)  =tr 

/I  (^4)  =/(i/e 

The  output  alphabet  has  instruetions  for  aeeelerating  {acc),  do  nothing  {nil),  turn 
soft  left  {tsl),  turn  hard  right  {tr)  and  idling  in  plaee  {idle).  The  UUV  in  this  example 
performs  instruetions  based  on  the  state  it  is  in.  In  the  start  state  qo  the  UUV  performs  an 
acc  instruetion.  In  state  q\  the  UUV  does  nothing  (a  nil  instruetion).  In  state  qi,  the  UUV 
exeeutes  a  tsl  instruetion  and  in  state  ^3,  a  tr  instruetion.  Finally,  in  state  q^  the  UUV 
executes  an  idle  instruction,  idling  the  UUV  in  place.  This  last  state  would  be  in 
conjunction  with  a  maneuver  to  the  surface  enabling  the  UUV  to  communicate  with  a 
host  ship. 

The  state  transition  diagram  for  the  Moore  machine  is  shown  in  Figure  5. 


C.  SAMPLING  RATE 

Key  to  the  coordination  of  multiple  UUVs  is  that  the  UUVs  sample  their  locations 
at  the  same  rate.  Moreover  they  must  sample  at  a  rate  that  guarantees  potential  collisions 
can  always  be  revealed  by  analyzing  their  plans  statically,  that  is,  before  they  are 
deployed. 

The  sampling  rate  is  Hsi  where  si  is  the  time  between  samples,  called  the  sample 
interval.  Let  the  Mission  Operating  Distance  {MD)  denote  the  Euclidean  distance 
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between  UUVs  for  safe  operation  (i.e.,  no  two  UUVs  should  be  closer  than  MD  from 
each  other).  The  MD  is  determined  strictly  by  the  UUV’s  capabilities  and  its  operators. 
Suppose  UUVa  moves  at  a  rate  of  xlMD  per  sample  interval  and  UUVb  moves  at  a  rate  of 
yIMD  per  sample  interval.  The  sample  interval  must  be  chosen  so  that  MD  >x  +  y.  This 
interval  is  short  enough  to  ensure  UUVs  sample  their  locations  at  least  once  to  detect 
whether  their  distance  apart  is  less  than  MD  no  matter  how  they  move  relative  to  one 
another  at  the  same  depth.  We  have  x  =  MD  si  vi  and  y  =  MD  si  V2  where  v;  and  V2  are  A 
and  B’s  velocities  respectively.  So  x  +  y  =  MD  si  (v;  +  V2).  Now  x  +  y  must  not  exceed 
MD,  or  MD  si  (v;  +  V2)  <  MD.  Thus  we  have  si  (v;  +  V2)  <  1 ,  or  si  <  l/(v;  +  V2). 

For  given  UUV  velocities,  the  sampling  rate  is  computed.  The  locations  at  which 
two  UUVs  are  expected  to  be  at  every  sample  must  appear  in  each  UUV’s  statically 
analyzed  plan.  This  does  not  imply  that  each  UUV  must  actually  sample  at  this  rate  when 
deployed.  At  run  time,  they  need  only  sample  frequently  enough  to  know  when  to 
perform  their  instructions  such  as  accelerating,  turning  or  stopping.  The  static  analysis  of 
plans  requires  more  frequent  sampling  than  actually  needs  to  occur  when  the  UUVs  are 
deployed.  A  subset  of  their  analyzed  plans  is  sufficient  at  run  time.  We  shall  see  an 
example  in  Chapter  V. 

D,  MERGING  UUV  PLANS 

The  primary  advantage  of  using  Moore  automata  to  express  UUV  plans  is  that 
multiple  plans  can  be  analyzed  by  computer  to  determine,  in  advance  of  deployment, 
whether  two  UUVs  deployed  jointly  would  conflict.  We  define  a  merge  operation  for  two 
plans  that  if  successful  produces  a  master  plan.  A  master  plan  is  merely  confirmation  that 
the  two  plans  can  operate  jointly  without  conflict.  If  the  merge  operation  fails  then  a 
conflict  exists  and  the  merge  operation  can  pinpoint  where  in  their  plans  they  interfere. 

The  product  of  two  plans  (Qj,Zi,  and  is  the 

plan  (QjXQ2,Ei  UE2,  Aj  u  A2,A,/1,(5),52))  where  5{i^p,q),AyjB^  =  i^p  ,q^  if 
Si(p,A)  =  p',  S2iq,B)  =  q' ,  A  is  a  subset  of  Zj,  5  is  a  subset  of  Z2  and  there  is  no 

point  X  in  A  and  y  in  B  such  that  the  Euclidean  distance  between  x  and  y  is  less  than  MD. 
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The  output  function  A  is  defined  as  A(/7,g)  =  (Aj  (/7),T2  (^))  •  Examples  of  the  merge 
operation  are  presented  in  Chapter  III. 
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III.  DEPLOYMENT  SCENARIOS 


This  chapter  includes  three  scenarios  of  joint  coordination  between  UUVs  using 
Moore  automata.  The  image  in  Figure  6  shows  the  grid  layout  used  in  the  scenarios.  The 
horizontal  and  vertical  axes  are  divided  into  increments  of  one  nautical  mile  (1852 
meters).  For  the  purpose  of  illustrating  the  scenarios  and  the  basic  concept,  Cartesian 
coordinates  are  used.  In  practice,  one  would  use  the  geographic  coordinate  system,  as 
defined  in  the  ISO  I91 1 1  standard,  instead. 


Figure  6.  Grid  for  Defining  UUV  Maneuvers 


A,  SCENARIO  ONE 

In  our  first  scenario,  the  goal  is  to  define  plans  for  the  deployment  of  two  UUVs 
operating  jointly  in  Monterey  Bay  in  support  of  NOAA  charting  and  ocean  floor 
characterization.  The  UUVs  will  surface  every  30  minutes  to  determine  their  (exact) 
location  via  GPS.  At  other  times,  their  location  is  estimated  using  onboard  dead¬ 
reckoning.  The  UUVs  will  not  surface  for  communication  with  the  host  ship  until  the 
mission  is  complete  or  they  find  themselves  unexpectedly  in  locations  not  accounted  for 
in  their  plans.  The  image  in  Figure  7  illustrates  this  scenario. 
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1,  Sample  Interval 

Both  UUVs  will  transit  at  1.5  knots  (.772  m/sec).  Using  this  information  we 
calculate  their  maximum  sample  interval: 

- ^ - «  648  msec/m  . 

.772 +  .772 

Therefore  the  sampling  rate  used  in  their  plans  must  be  at  least  one  sample  every 
648  msec  in  order  to  guarantee  that  any  collisions  can  be  detected  statically  (a  priori).  We 
choose  the  least  sampling  rate  (corresponding  to  the  maximum  sample  interval)  to  reduce 
the  size  of  each  UUV’s  plan  expressed  as  a  Moore  machine.  This  reduces  the  size  of  the 
plans  that  are  statically  analyzed  for  potential  conflicts  when  building  a  master  plan  for 
their  joint  operation.  The  illustration  in  Figure  7  depicts  their  intended  paths. 
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Figure  7.  Scenario  One 


2.  UUVa  Plan  (Blue) 

We  construct  the  Moore  machine  for  UUVa  using  the  pre-determined  speed  (1.5 
knots)  and  a  set  of  waypoints.  UUVa  will  travel  approximately  22,224  meters  and 
therefore  the  mission  will  take  about  eight  hours  to  complete  at  1.5  knots.  The  estimated 
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number  of  samples  then  for  UUVa  using  the  maximum  sample  interval,  total  distanee, 
and  distanee  traveled  per  sample  beeomes 


.648- 


sec 


sample 


nnn  “ 

-X.772 - ; 

sec 


.500- 


m 


22,224m 


sample 


.500 


m 


44, 627  samples 


sample 


At  one  transition  per  sample,  this  represents  the  number  of  states  of  the  Moore 
maehine  for  UUVa.  Eaeh  sample  generates  a  unique  Cartesian  point  that  serves  as  an 
input  to  the  Moore  maehine  for  UUVa.  In  the  interest  of  exposition,  the  eomplete  44,627- 
state  Moore  maehine  will  not  be  ineluded  here  but  rather  just  portions  of  it  to  show  the 
eoneept.  The  subset  shown  here  will  inelude  samples  every  hour,  eoineiding  with  every 
other  surfaee  GPS  positioning  maneuver.  Thus  the  portion  of  the  Moore  maehine  we 
show  has  only  eight  transitions  and  is  defined  as  follows: 

Qa  {  ^0  5^15  ^2  ’  ^3  ’  ^4  ’  ^5  ’  ^6  ’  ^7  ’  ^8  } 

(926,5556),  (926,2778),  (1852,926),  (4630,926), 

(7408,926),  (8334,2778),  (5556,2778),  (2778,2778) 

A -[idle,  acc,  nil] 


the  transition  funetion  5  is  defined  by 


(926,5556))  =aj 
d^[a2,  (1852,926)) 

S^(a„  (7408,926)) 

S^(a„  (5556,2778)) 
S^(a„  (2778,2778))  =a. 


S^{a^,  (926,2778)) 
(4630,926)) 
d^{a„  (8334,2778)) 
d^(a2,  (2778, 2778)) 
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and  the  output  function  I  is  defined  by 


A-a  (flo)  = 

Xa  (aj  =  nil  for  0  <  i  <  8 
(ag)  =  idle 

The  output  alphabet  has  instructions  for  accelerating  {acc),  do  nothing  {nil),  and 
idling  in  place  {idle).  The  UUV  in  this  example  performs  instructions  based  on  the  state  it 
is  in.  In  the  start  state  uq  the  UUV  performs  an  acc  instruction.  In  state  a\  thru  a?  the 
UUV  does  nothing.  Finally,  in  state  ag  the  UUV  executes  an  idle  instruction,  idling  the 
UUV  in  place.  This  last  state  would  be  in  conjunction  with  a  maneuver  to  the  surface 
enabling  the  UUV  to  communicate  with  a  host  ship. 

The  Moore  machine  can  also  be  expressed  as  a  state  transition  diagram  as 
discussed  in  Chapter  II.  The  Moore  machine  for  this  example  is  shown  in  Figure  8. 


Figure  8.  Subset  of  UUVa’s  Moore  Machine  as  a  State  Transition  Diagram 

Note  that  the  subset  of  the  Moore  machine  shown  does  not  include  all  maneuvers 
that  UUVa  expects  to  take  when  deployed.  It  merely  illustrates  a  portion  of  the  plan  as  a 
Moore  machine.  As  such,  it  is  insufficient  as  an  executable  machine  for  the  UUV  to  run 
when  the  UUV  is  actually  deployed.  A  subset  of  the  machine  for  actual  deployment  must 
include  all  maneuvers  and  will  be  given  in  Chapter  V. 
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3.  UUVb  Plan  (Red) 

We  construct  the  Moore  machine  for  UUVb  using  the  pre-determined  speed  (1.5 
knots)  and  a  set  of  waypoints.  In  this  scenario  UUVb  will  travel  about  the  same  distance 
as  UUVa  at  approximately  22,224  meters.  The  number  of  samples  is  also  the  same,  at 
44,627  samples.  As  with  UUVa,  the  Moore  machine  here  represents  only  a  portion  of  the 
complete  machine.  The  subset  of  the  Moore  machine  for  UUVb  has  only  eight  transitions 
and  is  defined  as  follows: 

^ B  ~  (  Qb  ,  S,  a,  ,  5^  ) 

Qb  ~  {^0  ’  ^1  ’  ^2  ’  ^3  ’  ^4  ’  ^5  ’  ^6  ’  ^7  ’  ^8  } 

(3704,8334),  (6482,8334),  (8334,7408),  (6482,6482), 

(3704,6482),  (2778,4630),  (5556,4630),  (8334,4630) 

A  =  {/r//e,  acc,  nil,  tr,  tl] 

the  transition  function  S  is  defined  by 

(3704,8334))  d,[b„  (6482,8334))  =b^ 

5^[b^,  (8334,7408))  =4  5^[b^,  (6482,6482))  =b, 

d,[b„  (3704,6482))  =b,  d,[b„  (2778,4630))  =b, 

d,[b„  (5556,4630))  =b,  d,[b,,  (8334,4630))  =  b^ 

S,(b„  (8334,4630))  ^b, 

and  the  output  function  I  is  defined  by 

^B  {K  )  = 

Xb  {b^ )  =  nil  for  0  <  /  <  3 
^5(^3)  =tr 
2,5(64)  =nil 
2,5  (6. )  =  t/  for  4  <  /  <  7 
2,5  (bj )  =  nil 
2,5  (6g )  =  idle 
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In  the  start  state  ho  it  performs  an  acc  instruction.  In  state  hi,  hi,  b^,  and  h?  it  does 
nothing.  In  state  hs  it  executes  a  tr  instruction.  In  state  hs  and  he  it  executes  a  tl 
instruction.  Finally,  in  state  hg  the  UUV  executes  an  idle  instruction,  idling  it  in  place. 

The  state  transition  diagram  for  this  Moore  machine  is  given  in  Figure  9. 


Figure  9.  Subset  of  UUVb’s  Moore  Machine  as  a  State  Transition  Diagram 

4,  Master  Plan  for  Scenario  One 

With  individual  plans  for  UUVa  and  UUVb,  an  attempt  to  construct  a  master  plan 
by  merging  their  individual  plans  can  be  made.  Merging  guarantees  absence  of  any 
conflicts  during  joint  operation,  meaning  they  always  operate  at  a  distance  at  least  as 
large  as  MD.  Therefore,  merging  requires  a  value  of  MD.  Suppose  for  this  scenario,  MD 
is  400  meters.  That  means  that  the  two  plans  cannot  be  merged,  according  to  the 
definition  of  merge  given  in  Chapter  2,  if  there  are  two  states,  one  from  each  plan,  from 
which  the  transitions  are  on  Cartesian  points  having  Euclidean  distance  less  than  400 
meters  in  two-dimensional  space.  In  this  scenario,  the  UUVs  do  not  conflict  with  MD  at 
400  meters.  In  other  words,  they  can  be  merged  resulting  in  a  master  plan.  The  master 
plan  as  a  Moore  machine  is  defined  as  follows: 
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Qab  ~  {(  ^0  ’  ^0  )  ’  (  ^1  ’  ^1  )  ’  (  ^2  ’  ^2  )  ’  ( ^3  ’  ^3  )  ’  ( ^4  ’  ^4  )  ’  (  ^5  ’  ^5  )  ’  (  ^6  ’  ^6  )  ’  (  ^7  ’  ^7  )  ’  (  ^8  ’  ^8  ) } 

'{(926, 5556), (3704, 8334)},  {(926,2778), (6482,8334)},  ' 

{(1852,926), (8334,7408)},  {(4630,926), (7408, 6482)}, 

I  {(7408, 926) ,  (3704, 6482)} ,  {(8334, 2778) , (2778, 4630)} , 

{(5556,2778), (5556, 4630)},  {(2778,2778), (8334, 4630)} 

A  =  [idle,  acc,  nil,  tr,  tl[ 

^AB={a^A) 


the  transition  function  8  is  defined  by 

^AB  ((^O’^o)’ 

{(926,5556), (3704,8334)}) 

-(ai,bi) 

^AB 

{(926,2778), (6482, 8334)}) 

—  (uij  5 1^2  ) 

^AB  ((^25^2)’ 

{(1852, 926), (8334,7408)}) 

=  (a3,b3) 

^AB  ((^3’^3)’ 

{(4630,926), (7408, 6482)}) 

=  {a„h,) 

^AB  ((^45^4)’ 

{(7408,926), (3704,6482)}) 

—  (^5,65) 

^AB  ((^5 ’^5)’ 

{(8334,2778), (2778,4630)}) 

=  («6.b6) 

^AB  ((^e’^e)’ 

{(5556,2778), (5556, 4630)}) 

—  [Uj,  by  ) 

^AB  ((^7  ’^7  )  ’ 

{(2778,2778), (8334, 4630)}) 

— (ag,bg) 

^AB  ((^8’^8)’ 

{(2778,2778), (8334, 4630)}) 

— (ag,bg) 
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and 

the  output  function  1  is  defined  by 

^AB 

(«o.^o) 

=  {acc, acc) 

^AB 

(ai,hi) 

=  {nil, nil) 

^AB 

{ciiA) 

=  {nil, nil) 

^AB 

{a„b^) 

=  {nil,tr) 

^AB 

{a.  A) 

=  {nil, nil) 

^AB 

=  {nil,tl) 

^AB 

{(^6  A) 

=  {nil,tl) 

^AB 

{a^A) 

=  {nil, nil) 

^AB 

00 

=  {idle, idle) 

In  the  start  state  (ao,  ho)  both  UUVs  perform  an  acc  instruction.  In  state  (ai,  hi) 

and  (a2,  ^2)  they  do  nothing.  In  state  (as,  hs)  UUVa  does  nothing  and  UUVb  performs  a  tr 
instruction.  In  state  {a^,  b^)  they  do  nothing.  In  state  (as,  hs)  and  (ae,  he)  UUVa  does 
nothing  and  UUVb  performs  a  tl  instruction.  In  state  (a?,  h?)  they  do  nothing.  Finally,  in 
state  (as,  hs)  both  UUVs  execute  an  idle  instruction,  idling  them  in  place. 

The  state  transition  diagram  for  the  master  Moore  machine  is  shown  in  Figure  10. 


Figure  10.  UUVab  Master  Plan  as  a  Moore  Machine 


The  existence  of  the  master  plan  implies  that  unless  there  are  unpredictable 
external  factors,  the  UUVs  will  not  come  within  400  meters  of  each  other  when  deployed 
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at  the  same  depth  from  their  respective  stated  origins  and  headings  with  their  stated 
velocities  remaining  constant. 


B,  SCENARIO  TWO 

In  the  second  scenario,  the  goal  is  to  define  plans  for  the  deployment  of  two 
UUVs  operating  jointly  in  search  of  a  downed  aircraft  in  the  Gulf  of  Oman.  The  UUVs 
will  surface  every  30  minutes  to  determine  their  (exact)  location  via  GPS.  At  other  times 
their  location  is  estimated  using  onboard  dead-reckoning.  The  UUVs  will  not  surface  for 
communication  with  the  host  ship  until  the  mission  is  complete  or  they  find  themselves 
unexpectedly  in  locations  not  accounted  for  in  their  plans.  The  image  in  Figure  11 
illustrates  this  scenario. 

1.  Sample  Interval 

UUVa  will  transit  at  1.0  knot  (.514  m/sec)  while  UUVb  will  travel  at  1.5  knots 
(.772m/sec).  Using  this  information  we  calculate  their  maximum  sample  interval: 

- ^ - «  778  msec/m  . 

.514  +  .772 

Therefore  the  sampling  rate  used  in  their  plans  must  be  at  least  one  sample  every 
778msec  in  order  to  guarantee  that  any  collisions  can  be  detected  statically.  Again  we 
choose  the  least  sampling  rate  (corresponding  to  the  maximum  sample  interval)  to  reduce 
the  size  of  the  Moore  machines  analyzed  in  our  attempt  to  build  a  master  plan. 
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Figure  11.  Scenario  Two 


2.  UUVa  Plan  (Blue) 

We  construct  the  Moore  machine  for  UUVa  using  the  predetermined  speed  (1.0 
knot)  and  a  set  of  waypoints.  UUVa  will  travel  approximately  25,928  meters  and 
therefore  the  mission  will  take  about  14  hours  to  complete  at  1.0  knot.  The  estimated 
number  of  samples  then  for  UUVa  using  the  sample  interval,  total  distance  traveled,  and 
the  distance  traveled  per  sample  becomes 


.778 


sec 


m 


X. 514- 
sample  sec 


.400- 


m 


25,928m 


sample 


.400- 


m 


64, 820  samples 


sample 


At  one  transition  per  sample,  this  represents  the  number  of  states  of  the  Moore 
machine  for  UUVa.  Each  sample  generates  a  unique  Cartesian  point  that  serves  as  an 
input  to  the  Moore  machine  for  UUVa.  As  with  scenario  one,  the  complete  Moore 
machine  will  not  be  included  here  but  rather  a  portion  of  it.  The  subset  shown  here  will 
include  samples  every  hour,  coinciding  with  every  other  surface  GPS  positioning 
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maneuver.  Therefore,  the  portion  of  the  Moore  maehine  shown  here  has  only  14 
transitions: 


^  I  ^0  ^  ^1  ’  ^2  ’  ^3  ’  ^4  ’  ^5  ’  ^6  ^  ^7  ’  ^8  ’  ^9  ’  ^10  ’  1  ^  ^12  ^  ^13  ’  ^14 

'(926,2778),  (926,926),  (2778,926),  (2778,2778),  (2778,4630), 

E  =  ]  (4630,4630),  (4630,2778),  (4630,2778),  (4630,926),  (6482,926), 
(6482,2778),  (6482,4630),  (8334,2778),  (8334,926) 

A  =  [idle,  acc,  nil,  tr,  tl[ 

the  transition  funetion  8  is  defined  by 

d^[a^,  (926,2778))  =  a,  8^[a„  (926,926))  =a^ 

(7^(^2,(2778,926))  =a^  (7^  (^3,  (2778,2778))  = 

d^[a^,  (2778,4630))  =^5  ^^(^5,  (4630,4630))  = 

(a,,  (4630,2778))  =^2  (7^(^2,(4630,926))  =(^5 

A^((Z3,  (6482,926))  =a,  d^(a„  {6A%1,111%))  =  a,, 

(7^(<2jo,  (6482,4630))  =  <4!jj  A^(<4!jj,  (8334,4630))  =  <2j2 

(7^ ((212,  (8334,2778))  =  (2i3  A^((2i3,  (8334,926))  =a^4 

(7^((?i4,  (8334,926))  =(?i4 

and  the  output  funetion  I 

((2o )  =  acc  ((2; )  =  nil 

((24 )  =  nil  X^  ((2^ )  =tr 

((26 )  =tr  X^  ((22 )  =  nil 

^a{‘^&)  ^a{‘^<))  =tl 

/l^((2io)  =nil  /l^((2ii)  =tr 

/1^((2i2)  =tr  /1^((2i3)  =nil 

^a{‘^\a)  =ldle 
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In  the  start  state  ao  it  performs  an  acc  instruetion.  In  state  a\,  a^,  a-j,  aio  and  an  it 
does  nothing.  In  state  ai,  as,  ag  and  it  executes  a  tl  instruction.  In  state  as,  ae,  an  and 
an  it  executes  a  tr  instruction.  Finally,  in  state  au  the  UUV  executes  an  idle  instruction, 
idling  it  in  place. 

The  state  transition  diagram  for  the  Moore  machine  is  shown  in  Figure  12. 


(926, 2778)  (926, 926)  (2778, 926)  (2778,2778)  (2778,4630)  (4630,4630)  (4630,2778) 

aO;occ''^ - I - *4  a5;ff  I - »-l  a6;ff 


(8334, 

926) 


(8334,926)  (8334,2778)  (8334,4630)  (6482,4630)  (6482, 2778)  (6482,926) 


(4630,926) 


Figure  12.  Subset  of  UUVa’s  Moore  Machine  as  a  State  Transition  Diagram 


3.  UUVb  Plan  (Red) 

We  construct  the  Moore  machine  for  UUVb  using  the  pre-determined  speed  (1.5 
knots)  and  a  set  of  waypoints.  In  this  scenario  UUVb  will  travel  about  the  same  distance 
as  UUVa  at  approximately  25,928  meters  and  therefore  the  mission  will  take  just  over  9 
hours  to  complete  at  1 .5  knots.  The  estimated  number  of  samples  then  for  UUVb  using 
the  sample  interval,  total  distance  traveled,  and  the  distance  traveled  per  sample  becomes 


sec  m 

.778 - X.772 - 

sample  sec 


.601- 


m 


25,928m 


sample 


m 


sample 


43,142  samples 


At  one  transition  per  sample,  this  represents  the  number  of  states  of  the  Moore 
machine  for  UUVb.  The  portion  of  the  43,142-state  machine  here  includes  samples  at 
every  hour,  coinciding  with  every  other  surface  GPS  positioning  maneuver.  Therefore, 
the  portion  of  the  Moore  machine  we  show  has  only  nine  state  transitions: 
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^ B  (  Qb  ?  2],  a,  ,  5^  ) 

0B  “  {^0  ’  ’  ^2  ’  ^3  ’  ^4  ’  ^5  ’  ^6  ’  ^7  ’  ^8  ’  ^9  } 

J(926,7408),  (2778,8334),  (2778,5556),  (4630,4630),  (4630,7408),! 
”1(6482,8334),  (6482,5556),  (8334,4630),  (8334,7408)  J 

Is. -{idle,  acc,  tr,  tl] 

the  transition  function  S  is  defined  by 

(926,7408))  -6;  (2778,8334))  -63 

Sj,(b2,  (2778,5556))  -63  Sj,(b„  (4630,4630))  =b, 

d^(b„  (4630,7408))  =b,  d„[b„  (6482,8334))  =b, 

d,[b„  (6482,5556))  =b,  dg[b,,  (8334,4630))  =  b^ 

d,[b„  (8334,7408))  =b,  d,[b„  (8334,7408))  =b, 

and  the  output  function  I  is  defined  by 

Xb  (6q  )  =  acc  Xg  (6j )  =  tr 
XB{b^)  =  tr  4(63)  =  ^/ 

4(64)  =  ^/  Xg{b,)  =  tr 
XB{b,)  =  tr  Xg{b,)  =  tl 

4  (4 )  =  t/  4  (^9 )  =  ^dle 

In  the  start  state  60  it  performs  an  acc  instruction.  In  state  b\,  62,  65  and  be  it 
executes  a  tr  instruction.  In  state  63,  64,  67  and  b%  it  executes  a  tl  instruction.  Finally,  in 
state  69  the  UUV  executes  an  idle  instruction,  idling  it  in  place. 

The  state  transition  diagram  for  the  Moore  machine  is  shown  in  Figure  13. 
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Figure  13.  Subset  of  UUVb’s  Moore  Machine  as  a  State  Transition  Diagram 


4.  Master  Plan  for  Scenario  Two 

Here,  much  like  scenario  one,  our  goal  is  to  guarantee  there  is  no  conflict  by 
attempting  to  merge  the  two  individual  plans.  For  this  scenario,  MD  is  200  meters.  In  this 
scenario,  the  UUVs  do  not  conflict  with  an  MD  of  200  meters.  The  result  is  that  the  two 
plans  can  indeed  be  merged,  resulting  in  the  following  master  plan  expressed  as  a  Moore 
machine. 

The  master  plan  is: 

^ AB  ~  (  QaB  »  2^5  ^5  ^AB  ’  ^AB  ’  ^ AB  ) 

'{(926,2778), (926, 7408)},  {(926,926), (2778,8334)}, 

{(2778,926), (2778,5556)},  {(2778,2778), (4630, 4630)}, 

{(2778, 4630), (4630, 7408)},  {(4630, 4630), (6482,8334)}, 

I  =  ]  {(4630,2778), (6482,5556)},  {(4630,926), (8334, 4630)} 

{(6482,926), (8334, 7408)},  {(6482,2778), (8334, 7408)} 

{(6482,4630), (8334, 7408)},  {(8334, 4630), (8334, 7408)} 

{(8334,2778), (8334, 7408)},  {(8334,926), (8334, 7408)} 

A  =  [idle,  acc,  nil,  tr,  tl[ 

Sb={(^oA) 
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The  transition  function  S  is  defined  by 

{(926, 2778), (926, 7408)})  =(a„b,) 

{(926,926), (2778,8334)})  =(a„h,) 

5., {(a2,h,),  {(2778,926), (2778,5556)})  =(^3,63) 

{(2778,2778), (4630, 4630)})  =(a4,b4) 
{(2778, 4630), (4630, 7408)})  =(a5,b3) 
^.4("'5’b5),  {(4630, 4630), (6482,8334)})  =(a„h,) 
{(4630,2778), (6482,5556)})  =(a3,b3) 

5., {(a2,h2),  {(4630,926), (8334,4630)})  =(a8,b8) 

{(6482,926), (8334,7408)})  =(s,b,) 

^AB{(a9A),  {(6482,2778), (8334,7408)})  =(a,o,b0 
^.4("'io’b,),  {(6482,4630), (8334, 7408)})  =(a„,b,) 
<^AB{(anA),  {(8334, 4630), (8334,7408)})  =(a,2A) 
^abH^uA)’  {(8334,2778), (8334,7408)})  =(a,3,b,) 
^ABii^nA),  {(8334,926), (8334,7408)})  =(a,4,b0 
^abH^iaA),  {(8334,926), (8334,7408)})  =(a,4,b9) 


and  the  output  function  I  is  defined  by 
/l^^(ao,6o)  -{acc,acc) 


(^4, 64) 

■^ABi^S’^s) 

( fifjo ,  69 )  =  {nil,  idle) 

Xab  (  «i2  5  69 )  =  {tr,  idle) 

( aj4 , 69 )  =  {idle,  idle) 


2^^(ai,6i)  =  (m7,ir) 

2^5(a3,63)  =  (i/,i/) 

4ij(«5.4)  =  (ir,tr) 

X^j;{a2,b2)^{nil,tl) 
X^s  ( ^9  5  69 )  =  (i/,  idle) 
X^g{a^^,b^)^{tr,idle) 
X^^  ( aj3 , 69 )  =  {nil,  idle) 
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The  state  transition  diagram  for  the  master  Moore  maehine  is  shown  in  Figure  14. 


{(926,2778),  {(926,926),  {(2778,926),  {(2778,2778),  {(2778,4630),  {(4630,4630),  {(4630,2778), 

(926,7408)1  (2778,8334)1  (2778,5556)1  (4630,4630)1  (4630,7408)1  (6482,8334)1  (6482,5556)1 


{(8334,926), 

(8334,7408)1 


{(8334,926),  {(8334,2778),  {(8334,4630),  {(6482,4630),  {(6482,2778),  {(6482,926),  {(4630,926), 

(8334,7408)1 (8334,7408)} (8334,7408)]_J8334,7408)|_(8334,7408)1 (8334,7408)1  (8334,4630)} 


Figure  14.  UUVab  Moore  Machine  Master  Plan 


C.  SCENARIO  THREE 

This  scenario  is  designed  specifically  to  show  conflict.  The  operating  area  is 
reduced  to  1852  m  to  allow  for  computation  of  the  sample  set  for  each  UUV  of  which  a 
portion  is  included  in  the  Appendix.  The  image  in  Figure  15  illustrates  this  scenario. 

1.  Sampling  Interval 

For  this  scenario  UUVa  will  transit  at  2.0  knots  (1.03  m/sec)  while  UUVb  will 
transit  at  1.0  knot  (.514  m/sec).  Using  this  information  we  calculate  their  maximum 
sample  interval: 

- - »  648msec/m . 

1.03  +  .514 

Therefore,  the  sampling  rate  used  in  their  plans  must  be  at  least  one  sample  every 
648msec  in  order  to  guarantee  that  any  collisions  can  be  detected  statically.  Again  we 
choose  the  least  sampling  rate  to  reduce  the  size  of  the  Moore  machines  for  static 
analysis. 
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Figure  15.  Scenario  Three 


2.  UUVa  Plan  (Blue) 

We  construct  the  Moore  machine  for  UUVa  using  the  pre-determined  speed  (2.0 
knots)  and  a  set  of  waypoints.  UUVa  will  travel  approximately  2,619  meters  therefore  the 
mission  will  take  about  40  minutes  to  complete  at  2.0  knots.  The  estimated  number  of 
samples  then  for  UUVa  using  the  sample  interval,  total  distance,  and  distance  traveled 
per  sample  becomes 


.648- 


sec 


sample 


-xl.03— ; 
sec 


.667- 


m 


2,619m 


sample 


.667 


m 


3,927  samples 


sample 


At  one  transition  per  sample,  this  represents  the  number  of  states  of  the  Moore 
machine  for  UUVa.  A  subset  of  the  3,927-state  machine  is  shown  using  eight  minute 
samples: 


33 


Qa  ~  I  5  5  ^^2  ’  ^3  ’  ^4  ’  ^5  } 

J(346.45, 1505.55),  (692.44,1159.57),  (1038.89,813.11),! 
”1(1384.87,467.13),  (1731.32,120.68)  j 

A  =  [idle,  acc,  nil] 

—  Uq 

the  transition  function  S  is  defined  by 

S^(a„  (346.45,1505.55)) 

(692.44,1159.57))  =a2 
S^(a2,  (1038.89,813.11))  =a3 
A^(a3,  (1384.87,467.13))  =a, 
d^(a„  (1731.32,120.68))  =a, 
d^(a„  (1731.32,120.68))  =a, 

and  the  output  function  I  is  defined  by 

A^a  («o)  “ 

Xa  (a. )  =  nil  for  0  <  1  <  5 
(a^ )  =  idle 

For  this  plan,  the  Cartesian  coordinates  are  taken  from  those  listed  in  the 
Appendix.  The  state  transition  diagram  for  the  Moore  machine  is  shown  in  Figure  16. 


Figure  16.  Subset  of  UUVa’s  Moore  Machine  as  a  State  Transition  Diagram 
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3. 


UUVb  Plan  (Red) 


We  construct  the  Moore  machine  for  UUVb  using  the  pre-determined  speed  (1.0 
knot)  and  a  set  of  waypoints.  UUVb  will  travel  approximately  2,619  meters  and  therefore 
the  mission  will  take  about  80  minutes  to  complete  at  1.0  knot.  The  estimated  number  of 
samples  then  for  UUVb  using  the  sample  interval,  total  distance,  and  distance  traveled 
per  sample  becomes 


y-  An,  n  A  A  AAA 

.648 - X.514 - 

sample  sec 


2,619m 


sample  ^  3  3  ^ 

sample 


7,865  samples 


At  one  transition  per  sample,  this  represents  the  number  of  states  of  the  Moore 
machine  for  UUVa-  A  subset  of  the  complete  7,865-state  machine  is  shown  below  using 
samples  every  8  minutes: 

^ B  ~  (  Qb  ’  ^B’^B’^B^ 

Qb  ~  {^0  ’  ^1  ’  ^2  ’  ^3  ’  ^4  ’  ^5  ’  ^6  ’  ^7  ’  ^8  ’  ^9  ’  ^10  } 

(174.53,174.53), (348. 83,348.83), 

(523.36,523.36), (697.66, 697.66), 

Z  =  J  (872.19,872.19), (1046.49,1046.49), 

(1221.02,1221.02), (1395.31,1395.31), 

(1569.85,1569.85), (1744.14,1744.14) 

A  =  {idle,  acc,  nil] 

Sb=K 
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the  transition  function  S  is  defined  by 


5b(K 

(174.53,174.53)) 

(348.83,348.83)) 

=  b^ 

Sb[K 

(523.36,523.36)) 

(697.66,697.66)) 

=  b. 

5b[K 

(872.19,872.19)) 

=  b, 

SB[bs, 

(1046.49,1046.49)) 

=  b, 

Sb[K^ 

(1221.02,1221.02)) 

=  b, 

SB{b,, 

(1395.31,1395.31)) 

=  4 

Sb[K 

(1569.85,1569.85)) 

=  b. 

5B[b^, 

(1744.14,1744.14)) 

“  bio 

g,(b,„  (1744.14,1744.14)) 

and  the  output  function  I  defined  by 

Xg  {pQ )  =  acc 

Xg  {bj )  =  nil  for  0  <  1  <  10 

Xg  {b^Q)-idle 

The  state  transition  diagram  for  the  Moore  machine  is  shown  in  Figure  17. 


Figure  17.  Subset  of  UUVb’s  Moore  Machine  as  a  State  Transition  Diagram 


4,  Master  Plan  for  Scenario  Three 

Here  we  attempt  to  construct  a  master  plan  with  MD  equal  to  600  meters.  Unlike 
scenarios  one  and  two,  when  we  attempt  to  merge  the  individual  plans  for  UUVa  and 
UUVb  to  create  the  master  plan,  a  conflict  is  detected.  Hence  no  master  plan  exists. 
However,  a  partial  master  plan  can  be  constructed  to  reveal  where  the  conflict  arises.  A 
partial  state  transition  diagram  for  the  master  Moore  machine  is  shown  in  Figure  18. 
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Figure  18.  Partial  Moore  Machine  for  Partial  Master  Plan 


Only  three  states  of  the  master  plan  are  possible,  as  illustrated  in  Figure  18.  There  is  a 
conflict  when  attempting  to  transition  out  of  state  (ai,  hi).  The  Appendix  shows  the 
samples  for  state  (ai,  b2)  and  (as,  bs)  to  be  1477  and  2216,  respectively.  In  state  (as,  bs) 
the  distance  between  the  two  UUVs  is  approximately  880  meters,  which  does  not  violate 
MD;  however,  in  state  (as,  bs)  the  distance  between  them  drops  to  approximately  591 
meters,  which  violates  MD.  Violation  of  MD  actually  occurred  at  sample  2164,  roughly 
23  minutes  into  their  planned  transits.  The  graph  in  Figure  19  shows  the  total  distance 
traveled  by  each  UUV  and  the  distance  between  them  at  each  sample,  had  there  been  no 
conflict.  After  UUVa  completes  its  mission,  it  sits  idle  while  UUVb  completes  its 
mission.  Although  not  readily  apparent,  the  green  line  showing  the  distance  between 
them  dips  below  MD. 

The  ability  to  identify  the  point  where  conflict  occurs  is  another  benefit  of  our 
approach.  It  suggests  ways  to  resolve  the  conflict,  for  example,  by  adjusting  MD  if 
possible,  adjusting  speed,  or  selecting  alternative  waypoints.  Once  the  adjustments  are 
made,  another  attempt  can  be  made  to  construct  a  master  plan. 
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Figure  19.  Scenario  Three  Distance  Graph 
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IV.  A  SURVEY  OF  RELATED  WORK 


As  mentioned  in  Chapter  I,  our  approaeh  is  aimed  at  rapid  deployment  of  multiple 
UUVs  without  relying  on  any  communication  between  them.  Much  of  the  work  in  joint 
UUV  deployment  relies  on  communication.  As  such,  it  is  not  well  suited  for  the  type  of 
deployment  we  aim  to  address:  a  coalition  marshaling  UUVs  on  short  notice  to  operate 
jointly  without  communication.  Nevertheless,  it  is  instructive  to  understand  some  of  this 
work.  Some  kind  of  hybrid  approach  may  be  needed  to  address  individual  UUV  recovery 
plans,  which  are  a  source  of  difficulty;  see  Chapter  V. 

A,  COMMUNICATION-BASED  UUV  OPERATIONS 

Ouimet  [2]  expanded  on  previous  work  with  undersea  acoustic  networking 
technology  developed  by  the  Navy  to  navigate  Slocum  glider  UUVs.  In  his  experiments  it 
is  evident  that  environmental  factors  and  underwater  sound  propagation  issues  all 
contributed  to  the  high  error  rates  observed.  It  was  intended  as  a  fundamental  step 
towards  UUV  swarm  collaboration;  however,  there  appears  to  be  no  follow-up  to  his 
work. 

Realizing  the  limitation  on  providing  the  warfare  commander  with  near  real-time 
data  from  AUVs  on  station,  Marr  [6]  proposed  and  simulated  rendezvous  capabilities 
between  multiple  AUVs.  A  “searcher”  AUV  acoustically  offloaded  data  to  a  “server” 
AUV  that  then  surfaced  and  transmitted  data  to  the  warfare  commander  via  radio 
frequency  (RF)  or  satellite  link.  This  method  allowed  the  “searcher”  AUV  to  remain  on 
station  to  provide  continuous  support.  Much  like  the  previous  example,  Marr  realized 
underwater  sound  propagation  severely  limited  the  acceptable  distances  for  transferring 
data  between  the  two  AUVs. 

Nicholson’s  [5]  efforts  demonstrated  partial  implementation  of  Marr’s  [6]  work. 
Nicholson  proposed  rendezvous  capabilities  between  multiple  AUVs  using  the  acoustic 
radio  interactive  exploratory  server  (ARIES)  AUV.  Much  like  [6],  to  maximize  time-on- 
station  in  data-gathering  AUVs,  deployment  of  a  “server”  AUV  was  tasked  with 
downloading  data  from  a  data-gathering  AUV,  minimizing  downtime  and  maximizing 
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data  collection.  Nicholson  demonstrated  successful  rendezvous  and  communications 
between  an  ARIES  AUV  (server)  and  a  pre-programmed  virtual  AUV  (data-gatherer). 

While  their  efforts  demonstrate  some  form  of  coordination,  it  also  highlights  the 
inherent  weaknesses  in  sound  propagation.  This  thesis  demonstrated  a  new  method  for 
UUV  coordination  without  the  use  of  any  underwater  communications.  The  remainder  of 
this  section  discusses  three  research  projects  that  were  effective  in  the  coordination  of 
multiple  UUVs  without  any,  or  very  little,  communications  between  them. 

B,  A  TWO-LEVEL,  PROTOCOL-BASED  APPROACH  TO  CONTROLLING 

AUTONOMOUS  OCEANOGRAPHIC  SAMPLING  NETWORKS 

Turner  [4]  presented  an  approach  to  adapt  the  existing  autonomous  oceanographic 
sampling  networks  (AOSN)  construct  to  handle  more  complex  mission  control  for  UUVs. 
His  cooperative  distributed  AOSN,  or  CoDA,  was  a  project  that  focused  on  intelligent 
control  mechanisms  for  advanced  AOSNs.  AOSNs  are  discussed  in  detail  in  [8].  AOSNs 
were  originally  developed  to  advance  the  state-of-the-art  in  understanding  ocean 
characteristics.  Turner  identified  a  need  for  better  network  management  given  the  myriad 
of  environmental  and  mechanical  factors  involved  in  maintaining  an  underwater  network 
for  an  extended  period  of  time.  Turner’s  work  was  unique  in  that  it  introduced  a  self- 
sufficient  hierarchy  into  the  network  by  creating  the  meta-level  organization  (MLO)  and 
task-level  organization  (TLO).  The  MLO  determined  the  capability  of  the  AOSN  as  a 
whole;  this  included  all  nodes  and  UUVs  involved,  taking  into  account  their  capabilities 
and  limitations.  The  MLO  addressed  extended  operations  by  dynamically  reorganizing 
the  network  based  on  the  environment;  whether  due  to  vehicles  coming  or  leaving  the 
network,  vehicles  failing,  or  other  environmental  factors.  The  TLO  then  assigned  tasks 
based  the  MLO  input.  This  project  was  platform  agnostic  and  tasked  the  inquiring  AUV 
based  on  its  capabilities,  identified  during  initial  deployment  into  the  network.  If  a  tasked 
UUV  failed  during  operation,  the  network  would  dynamically  reorganize  and  reassign 
missions  to  other  capable  AUVs. 
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While  Turner’s  work  demonstrated  eoordination  among  AUVs  and  an  underwater 
network,  it  did  so  while  relying  on  underwater  eommunieations.  Additionally,  the 
hierarehieal  setup  of  his  network  required  that  the  UUVs  be  aware  of  one  another. 

C.  COORDINATED  CONTROL  OF  MULTIPLE  AUTONOMOUS 
UNDERWATER  VEHICLE  SYSTEMS 

D.  Jiang  et  al.  [9]  builds  on  Botelho’s  [10]  robot  eoordination  eoneept  and  applies 
it  to  UUV  eoordination.  D.  Jiang  et  al.  used  the  mission-oriented  operating  suite  interval 
programming  (MOOS-IvP)  arehiteeture  (open  souree)  and  a  market-based  approaeh  to 
fully  realize  distributed  control  of  underwater  vehicles  with  tightly  coupled  actions.  P. 
Newman  [11]  defined  MOOS  as: 

A  set  of  libraries  and  applications  designed  to  facilitate  research  in  the 
mobile  robotic  domain.  The  spectrum  of  functionality  provided  ranges 
over  low-level,  multi-platform  communications,  dynamic  control,  high 
precision  navigation  and  path  planning,  concurrent  mission  task  arbitration 
and  execution,  mission  logging  and  playback. 

According  to  [9],  MOOS  functioned  as  a  suite  of  software  modules  that 
coordinate  software  processes  running  on  an  autonomous  platform.  The  IvP  was  a 
technique  for  solving  multi-objective  optimization  problems. 

In  [9],  an  auctioneer  AUV  declared  a  set  of  tasks,  and  each  AUV  calculated  its 
cost  to  execute  those  tasks.  Each  AUV  carried  its  own  standardized  database,  which  it 
then  communicated  using  a  unified  communication  interface — called  MOOSBridge — to  a 
central  database  that  housed  similar  information  from  other  AUV  subscribers.  This 
central  database  fed  the  necessary  information  back  individual  subscribers,  making  them 
aware  of  other  taskings,  allowing  the  group  to  continue  in  a  coordinated  fashion. 
Whichever  AUV  submitted  the  lowest  bid  would  win  that  auction.  This  construct 
required  underwater  communications  between  the  AUVs  and  a  central  database. 
However,  the  AUVs  were  programmed  to  limit  communications  due  to  sound 
propagation  concerns.  Simulations  for  this  project  showed  the  behavior  of  AUVs 
operating  as  intended,  as  seen  in  Figure  20.  The  objective  of  this  simulation  was  to  visit 
each  station  while  minimizing  distance  traveled  between  all  three  AUVs. 
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Figure  20.  MOOS-IvP  Simulation  Test  Run  using  the  pMarineViewer 

Graphical  User  Interface,  from  [9] 


Some  of  the  weaknesses  in  this  project  were  as  follows.  Although  D.  Jiang  et  al. 
[9]  used  their  MOOSBridge  module  to  simulate  the  unified  communications  between  the 
vehicles,  they  did  so  over  a  local  area  network  (LAN).  This  eliminated  demonstrating  the 
biggest  constraint — underwater  communications.  Additionally,  their  simulations  did  not 
indicate  whether  their  network  retained  the  ability  to  adapt  to  a  loss  of  resources,  for 
example,  an  AUV  failure.  While  this  project  demonstrated  both  coordinated  and 
independent  movement  of  AUVs,  it  did  so  using  underwater  communications. 

D.  MULTI-AUV  CONTROL  AND  ADAPTIVE  SAMPLING  IN  MONTEREY 

BAY 

Fiorelli  et  al.  [12]  described  a  process  for  multi-AUV  control  using  virtual  bodies 
and  artificial  potentials  (VBAP).  This  project  is  of  particular  interest  because  it  managed 
multi-AUV  control  without  the  use  of  underwater  communications.  Artificial  potential 
fields  (APFs)  were  used  to  drive  the  autonomous  vehicles  toward  a  desired  goal,  or  end 
state.  The  use  of  APFs  also  enabled  autonomous  formation  control  between  the 
cooperating  AUVs.  More  information  on  APFs  can  be  found  in  [13]. 

The  virtual  body  introduced  the  mission  to  the  group  of  AUVs,  synchronizing 
formation  control  efforts  with  the  desired  task.  Waypoint  lists  were  generated  using 
VBAP  output  and  transmitted  to  the  gliders  via  an  Iridium  connection.  During  this 
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experiment,  the  AUVs  surfaced  every  two  hours  to  receive  mission  updates  using 
previously  uploaded  data  from  the  lead  AUV.  Through  intensive  human  intervention 
(every  two  hours),  the  formations  were  able  to  operate  autonomously  towards  a  goal 
without  the  use  of  underwater  communications.  This  project  advanced  existing  theory  by 
demonstrating  the  use  of  VBAP  in  multi-AUV  control.  Additional  contributions  in  this 
work  included  the  ability  of  the  formation  to  adjust  its  mission  based  on  real-time 
sampling  results.  While  this  was  nothing  new  for  an  individual  AUV,  it  was  new  for  a 
group  of  AUVs  to  move  in  concert  based  on  sample  data.  Some  of  the  weaknesses  in  this 
project  are  as  follows: 

•  Gliders,  in  general,  are  slow  and  average  a  constant  speed  due  to  the 
nature  of  their  design.  This  made  it  difficult  for  AUVs  to  maintain 
formation  when  external  factors,  such  as  current,  weather,  etc.,  were 
affecting  their  ability  to  navigate.  It  also  inhibited  implementation  of 
formation  control  using  artificial  potentials. 

•  Ideally,  the  goal  was  to  use  the  most  recent  offloaded  data  to  generate  the 
next  two-hour  mission  interval;  however,  to  minimize  the  time  AUVs 
spent  on  the  surface,  data  from  the  previous  cycle  was  used  instead. 

•  The  latest  mission  was  uploaded  to  the  lead  AUV,  and  then  it  resumed 
operations.  This  limited  the  ability  of  the  operator  to  upload  newer,  more 
recent  or  accurate  data  to  the  subsequent  surfacing  AUVs.  Had  the 
operator  done  so,  the  AUVs  would  no  longer  have  been  synchronized  with 
the  lead  glider. 

While  demonstrating  multi-AUV  coordination  without  underwater 
communication,  Fiorelli  et  al.  [12]  did  so  at  the  expense  of  near  continuous  human-in- 
the-loop  support,  limiting  the  deployment  feasibility  in  a  real  world  scenario. 
Additionally,  there  was  no  demonstration  of  independent  AUV  operation  using  the 
VBAP  construct.  This  thesis,  by  contrast  focuses  on  the  ability  to  rapidly  deploy  multiple 
AUVs,  independently  with  little  to  no  preparation,  very  little  human-in-the-loop 
intervention  and  no  underwater  communications. 

One  of  the  fundamental  capabilities  absent  from  these  examples  is  rapid 
deployment.  The  term  rapid  is  synonymous  with  nearly  every  capability  listed  in  the 
Navy’s  master  plan  [1].  Additionally,  there  needs  to  be  another  way  to  ensure  success  in 
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coordination  without  relying  on  underwater  communications.  Lastly,  the  requisite 
manpower  required  for  the  coordination  demonstrated  in  these  examples  is  impractical. 
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V.  CONCLUSIONS  AND  FUTURE  WORK 


This  thesis  presents  a  new  approaeh  to  autonomous  underwater  vehicle  navigation 
based  on  the  static  analysis  of  their  plans.  Autonomous  vehicles  are  normally  controlled 
by  software  expressed  in  a  control  language  that  defies  mechanical  processing. 
Consequently,  the  software  cannot  be  easily,  if  at  all,  analyzed  by  machine  to  determine 
whether  there  may  be  conflicts  among  UUV  plans.  This  thesis  proposes  a  new  technique 
for  expressing  plans,  called  Moore  automata.  These  automata  are  more  amenable  to  static 
analysis  for  detecting  conflicts. 

There  are  aspects  of  the  new  approach  that  require  attention,  notably, 
considerations  for  its  practical  use  and  its  inherent  limitations.  This  chapter  addresses 
both. 

A.  PRACTICAL  CONSIDERATIONS 

1,  Static  versus  Runtime  Plans 

The  velocities  of  UUVs  determine  a  maximum  sample  interval.  It  gives  the 
smallest  sampling  rate  for  the  UUVs;  however,  the  rate  can  cause  a  large  number  of  states 
in  the  Moore  automata  describing  their  plans.  We  call  these  plans  their  static  plans  to 
distinguish  them  from  the  plans  they  actually  run  when  deployed,  which  we  call  their 
runtime  plans.  If  the  static  plans  have  a  master  plan  then  there  is  no  conflict  for  the 
chosen  MD.  From  the  static  plans  one  can  extract  a  runtime  plan  based  on  an  even 
smaller  sampling  rate,  giving  rise  to  far  fewer  states  in  the  Moore  machine.  The  only 
requirement  is  that  all  maneuvers  in  the  static  plan  be  preserved  in  the  runtime  plan. 

For  example,  we  can  extract  a  runtime  plan  from  the  Moore  machine  static  plan 
for  UUVa  of  the  first  scenario  in  Chapter  III  Its  definition  is  given  as  follows: 
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Qa  {^0  ’  ^1  ’  ^2  ’  ^3  ’  ^4  ’  ^5  ’  ^6  i 

f(926,1852),  (1852,926),  (7408,926),! 

”1(8334,1852),  (7408,2778),  (2778,2778)} 

A  =  {idle,  acc,  nil,  tsl{ 

Sa  =a. 

The  state  transition  diagram  for  UUVa’s  runtime  plan  is  shown  in  Figure  21. 


Figure  21 .  State  Transition  Diagram  for  Seenario  One  Runtime  Plan 

The  resulting  runtime  plan  eonsists  of  seven  states,  and  preserves  the  output  of 
UUVa  whieh  is  neeessary  for  maneuvers.  This  is  far  fewer  than  the  44,627  states  required 
for  statie  analysis. 

2,  Tolerance 

Interference  is  detected  during  static  analysis  by  computing  the  Euclidean 
distance  between  two  coordinates  in  two-dimensional  space.  If  weather  conditions  or 
other  factors  suggest  that  UUVs  might  deviate  from  their  plans  when  deployed,  then  one 
can  introduce  an  error  tolerance  into  the  analysis.  However,  this  makes  the  detection  of  a 
collision  more  likely  with  the  same  input  parameters,  depending  on  the  tolerance. 
Favorable  conditions,  for  example,  sea  state,  weather,  and  shallow  or  deep  operations, 
would  call  for  a  smaller  tolerance.  The  greater  the  error  tolerance,  the  more  likely  there  is 
a  collision  detected  by  the  static  analysis. 
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For  instance,  suppose  eonditions  support  a  5%  error  tolerance  and  let  MD  be  400 
meters.  Tolerance  then  becomes  400(.05)  =  20  meters  .  We  replace  MD  with  MDtoierance 

where  MDtoierance  IS  defined  as  MD  +  2r  =  440  meters .  MDtoierance  refleets  the  worst-case 
situation,  in  whieh  two  UUVs  are  operating  at  the  edge  of  their  tolerance  elosest  to  eaeh 
other.  If  conditions  were  less  favorable,  we  might  use  a  tolerance  of  15%;  this  results  in 
an  acceptable  radius  of  60  meters  for  eaeh  UUV  and  an  MD^ierance  of  520  meters. 

3,  Static  Analysis  for  Three  Dimensions 

UUVs  operate  in  a  three  dimensional  environment,  and  although  this  thesis 
limited  the  analysis  to  two  dimensions,  little  additional  work  is  needed  to  apply  these 
results  to  a  three  dimensional  environment.  UUVs,  partieularly  gliders,  operate  at  fixed 
depth  windows  called  a  yo-yo.  You  can  set  a  max  depth  and  max  ceiling  to  define  a  yo¬ 
yo.  De-conflicting  yo-yo  ceiling  and  depth  figures  during  static  analysis  would  resolve 
any  concerns  over  conflict  in  that  third  dimension.  Furthermore,  Euclidean  distance  in 
three  dimensions  is  also  well  defined. 

4.  More  than  Two  UUVs 

If  the  plan  is  to  deploy  more  than  two  UUVs  then  their  static  plans  must  agree  on 
a  sampling  rate.  How  is  this  rate  determined?  The  sound  approaeh  is  to  take  the  worst- 
case  sampling  rate  eorresponding  to  the  two  fastest  UUVs  assuming  they  are  heading 
direetly  for  eaeh  other,  even  though  they  may  have  no  intention  of  doing  so.  Let  v,  and  v, 
be  the  two  fastest  veloeities  in  a  group  of  UUVs  (v;,  V2,  ...,v„),  then 

1 

V,+V. 

becomes  the  desired  sample  interval. 

B,  INHERENT  LIMITATIONS 

As  this  approach  is  based  on  static  analysis,  it  is  attempting  to  say  something 
about  runtime  behavior  by  examining  only  static  information.  The  static  analysis  is 
precise  to  the  extent  that  the  information  it  uses  remains  statie.  If  after  a  static  analysis 
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has  determined  there  is  a  master  plan  for  two  UUVs,  but  then  the  UUVs  don’t  follow 
their  extracted  runtime  plans  when  deployed  for  whatever  reason — perhaps  beyond  their 
control — then  the  analysis  is  useless.  This  is  true  of  any  static  analysis.  However,  it  is 
conjectured  that  there  are  many  useful  situations  in  which  information  about  UUV 
navigation  does  remain  static  so  static  analysis  wins.  But  there  are  other  situations  in 
which  it  does  not.  We  look  at  two  of  them  here. 

1.  Changing  Velocity  during  Runtime 

If  a  UUV  determines  during  runtime  that  it  needs  to  speed  up  based  on 
information  not  available  during  the  static  analysis,  such  as  speed  of  the  current,  then 
there  is  no  way  to  account  for  this  a  priori.  Accounting  for  changes  in  speed  in  the  static 
analysis  is  only  possible  if  these  changes  are  known  at  the  time  of  the  analysis. 
Otherwise,  any  master  plan  constructed  is  meaningless  even  if  operating  conditions  are 
predictable. 

2,  Recovery  from  Unpredictable  Conditions 

Inevitably,  at  some  point  during  operation  a  UUV  will  find  itself  in  an  unexpected 
location,  due  perhaps  to  changes  in  current,  weather  or  some  other  external  factor.  This 
location  may  not  be  accounted  for  in  the  UUV’s  runtime  plan.  A  UUV  can  have  as  part  of 
its  plan  some  recovery  maneuvers.  But  a  problem  arises  if  one  tries  to  construct  a  master 
plan  for  multiple  UUVs  and  each  UUV  has  recovery  maneuvers. 

For  instance,  say  an  attempt  to  merge  the  plans  of  two  UUVs  reveals  a  conflict 

because  of  an  attempt  to  transition  on  the  same  Cartesian  point.  To  resolve  the  conflict 

one  of  the  UUVs  must  not  take  that  transition,  and  instead  must  transition  to  another 

conditional  state;  however,  there  is  no  way  to  account  for  the  conditional  state  in  the 

static  plan  because  there  is  no  way  to  know  a  priori  what  factors  caused  the  UUV  to 

arrive  at  that  state.  This  example  is  illustrated  in  Figure  22.  The  transition  diagram  (a) 

represents  a  UUV  that  will  transition  on  the  coordinates  {x\,  y\).  The  transition  diagram 

(b)  represents  a  UUV  that  also  intends  to  transition  on  the  coordinates  (xi,yi);  however,  it 

also  has  a  transition  on  (x2,  yi)  just  in  case  it  finds  itself  in  this  location  for  reasons 

beyond  its  control.  It  then  tries  to  recover  with  a  tr  instruction.  In  an  attempt  to  merge  the 
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plans,  the  only  option  the  UUV  in  (b)  has  is  to  transition  on  (x2, 72)  but  it  does  not  know 
how  to  reaeh  that  location  because  it’s  a  location  reached  beyond  its  control.  No  such 
location  can  be  part  of  any  master  plan. 


Figure  22.  Reproducing  an  Unpredictable  Condition 


C.  FUTURE  WORK 

1.  Planned  Changes  in  Velocity 

In  order  to  treat  changing  velocities,  consider  the  case  in  which  two  UUVs  have 
multiple  speed  adjustments  built  into  their  plans.  Each  adjusts  its  speed  independently.  A 
new  sampling  rate  must  be  calculated  for  every  interval  where  an  interval  is  defined  to  be 
the  time  from  when  a  UUV  changes  its  speed  until  it  or  the  other  UUV  changes  its  speed, 
if  ever  again.  An  attempt  is  made  to  construct  a  master  plan  for  each  interval.  If 
successful,  then  there  is  a  master  plan  for  the  entire  mission. 

2.  Recovery  from  Unpredictable  Conditions 

An  important  area  of  future  work  is  coping  with  recovery  steps  that  a  UUV  takes 
in  response  to  unforeseen  operating  conditions.  A  recovery  maneuver  cannot  be  part  of 
any  master  plan  because  it  is  taken  due  to  circumstances  beyond  the  UUV’s  control. 
Further,  a  UUV  might  try  to  recover  while  in  a  recovery!  Currently,  no  recovery  paths 
can  be  part  of  any  plan.  This  is  where  a  hybrid  approach  may  be  useful,  one  that 
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combines  static  analysis  with  some  runtime  communications  just  in  the  event  a  UUV 
finds  it  has  deviated  from  its  plan. 
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APPENDIX.  SCENARIO  THREE  CALCULATIONS 


Vehicle  B 

Distance  (A,  B) 

Sample  # 

Time{sec} 

Dist  AtrvI  (m) 

Dist  BtrvI  (m) 

xl 

yi 

x2 

y2 

1457 

947.05 

965.991 

486.638 

683.0587867 

1168.941213 

344.1050298 

344.1050298 

891.7647554 

1458 

947.7 

966.654 

486.972 

683.5275985 

1168.472402 

344.3412034 

344.3412034 

891.2012355 

1459 

948.35 

967.317 

487.306 

683.9964103 

1168.00359 

344.5773771 

344.5773771 

890.6379779 

1460 

949 

967.98 

487.64 

684.4652221 

1167.534778 

344.8135508 

344.8135508 

890.074983 

1461 

949.65 

968.643 

487.974 

684.9340338 

1167.065966 

345.0497244 

345.0497244 

889.5122514 

1462 

950.3 

969.306 

488.308 

685.4028456 

1166.597154 

345.2858981 

345.2858981 

888.9497835 

1463 

950.95 

969.969 

488.642 

685.8716574 

1166.128343 

345.5220718 

345.5220718 

888.3875799 

1464 

951.6 

970.632 

488.976 

686.3404692 

1165.659531 

345.7582454 

345.7582454 

887.825641 

1465 

952.25 

971.295 

489.31 

686.809281 

1165.190719 

345.9944191 

345.9944191 

887.2639674 

1466 

952.9 

971.958 

489.644 

687.2780928 

1164.721907 

346.2305928 

346.2305928 

886.7025595 

1467 

953.55 

972.621 

489.978 

687.7469046 

1164.253095 

346.4667664 

346.4667664 

886.1414179 

1468 

954.2 

973.284 

490.312 

688.2157164 

1163.784284 

346.7029401 

346.7029401 

885.5805431 

1469 

954.85 

973.947 

490.646 

688.6845282 

1163.315472 

346.9391138 

346.9391138 

885.0199355 

1470 

955.5 

974.61 

490.98 

689.15334 

1162.84666 

347.1752874 

347.1752874 

884.4595957 

1471 

956.15 

975.273 

491.314 

689.6221518 

1162.377848 

347.4114611 

347.4114611 

883.8995242 

1472 

956.8 

975.936 

491.648 

690.0909636 

1161.909036 

347.6476348 

347.6476348 

883.3397216 

1473 

957.45 

976.599 

491.982 

690.5597754 

1161.440225 

347.8838084 

347.8838084 

882.7801882 

1474 

958.1 

977.262 

492.316 

691.0285872 

1160.971413 

348.1199821 

348.1199821 

882.2209246 

1475 

958.75 

977.925 

492.65 

691.497399 

1160.502601 

348.3561558 

348.3561558 

881.6619314 

1476 

959.4 

978.588 

492.984 

691.9662108 

1160.033789 

348.5923294 

348.5923294 

881.1032091 

1477 

960.05 

979.251 

493.318 

692.4350226 

1159.564977 

348.8285031 

348.8285031 

880.5447581 

1478 

960.7 

979.914 

493.652 

692.9038344 

1159.096166 

349.0646767 

349.0646767 

879.986579 

1479 

961.35 

980.577 

493.986 

693.3726462 

1158.627354 

349.3008504 

349.3008504 

879.4286724 

1480 

962 

981.24 

494.32 

693.841458 

1158.158542 

349.5370241 

349.5370241 

878.8710386 

1481 

962.65 

981.903 

494.654 

694.3102698 

1157.68973 

349.7731977 

349.7731977 

878.3136783 

1482 

963.3 

982.566 

494.988 

694.7790816 

1157.220918 

350.0093714 

350.0093714 

877.7565919 

1483 

963.95 

983.229 

495.322 

695.2478934 

1156.752107 

350.2455451 

350.2455451 

877.1997801 

1484 

964.6 

983.892 

495.656 

695.7167052 

1156.283295 

350.4817187 

350.4817187 

876.6432432 

1485 

965.25 

984.555 

495.99 

696.185517 

1155.814483 

350.7178924 

350.7178924 

876.0869819 

1486 

965.9 

985.218 

496.324 

696.6543287 

1155.345671 

350.9540661 

350.9540661 

875.5309967 

1487 

966.55 

985.881 

496.658 

697.1231405 

1154.876859 

351.1902397 

351.1902397 

874.975288 

1488 

967.2 

986.544 

496.992 

697.5919523 

1154.408048 

351.4264134 

351.4264134 

874.4198564 

1489 

967.85 

987.207 

497.326 

698.0607641 

1153.939236 

351.6625871 

351.6625871 

873.8647025 

1490 

968.5 

987.87 

497.66 

698.5295759 

1153.470424 

351.8987607 

351.8987607 

873.3098268 

1491 

969.15 

988.533 

497.994 

698.9983877 

1153.001612 

352.1349344 

352.1349344 

872.7552297 

1492 

969.8 

989.196 

498.328 

699.4671995 

1152.5328 

352.3711081 

352.3711081 

872.2009119 

1493 

970.45 

989.859 

498.662 

699.9360113 

1152.063989 

352.6072817 

352.6072817 

871.6468739 

1494 

971.1 

990.522 

498.996 

700.4048231 

1151.595177 

352.8434554 

352.8434554 

871.0931161 

1495 

971.75 

991.185 

499.33 

700.8736349 

1151.126365 

353.079629 

353.079629 

870.5396392 

1496 

972.4 

991.848 

499.664 

701.3424467 

1150.657553 

353.3158027 

353.3158027 

869.9864437 

1497 

973.05 

992.511 

499.998 

701.8112585 

1150.188741 

353.5519764 

353.5519764 

869.43353 

1498 

973.7 

993.174 

500.332 

702.2800703 

1149.71993 

353.78815 

353.78815 

868.8808988 

1499 

974.35 

993.837 

500.666 

702.7488821 

1149.251118 

354.0243237 

354.0243237 

868.3285506 

1500 

975 

994.5 

501 

703.2176939 

1148.782306 

354.2604974 

354.2604974 

867.7764859 

1501 

975.65 

995.163 

501.334 

703.6865057 

1148.313494 

354.496671 

354.496671 

867.2247053 

1502 

976.3 

995.826 

501.668 

704.1553175 

1147.844683 

354.7328447 

354.7328447 

866.6732093 

1503 

976.95 

996.489 

502.002 

704.6241293 

1147.375871 

354.9690184 

354.9690184 

866.1219985 

1504 

977.6 

997.152 

502.336 

705.0929411 

1146.907059 

355.205192 

355.205192 

865.5710733 

1505 

978.25 

997.815 

502.67 

705.5617529 

1146.438247 

355.4413657 

355.4413657 

865.0204344 

1506 

978.9 

998.478 

503.004 

706.0305647 

1145.969435 

355.6775394 

355.6775394 

864.4700823 

1507 

979.55 

999.141 

503.338 

706.4993765 

1145.500624 

355.913713 

355.913713 

863.9200175 

1508 

980.2 

999.804 

503.672 

706.9681883 

1145.031812 

356.1498867 

356.1498867 

863.3702406 

1509 

980.85 

1000.467 

504.006 

707.4370001 

1144.563 

356.3860604 

356.3860604 

862.8207522 

1510 

981.5 

1001.13 

504.34 

707.9058118 

1144.094188 

356.622234 

356.622234 

862.2715527 
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Vehicle  B 

Distance  (A,  B) 

Sample  # 

Time{sec) 

Dist  AtrvI  (m) 

Dist  BtrvI  (m) 

xl 

yi 

x2 

y2 

2185 

1420.25 

1448.655 

729.79 

1024.353774 

827.6462259 

516.0394578 

516.0394578 

596.2232988 

2186 

1420.9 

1449.318 

730.124 

1024.822586 

827.1774141 

516.2756315 

516.2756315 

596.0536245 

2187 

1421.55 

1449.981 

730.458 

1025.291398 

826.7086023 

516.5118052 

516.5118052 

595.8848267 

2188 

1422.2 

1450.644 

730.792 

1025.760209 

826.2397905 

516.7479788 

516.7479788 

595.7169063 

2189 

1422.85 

1451.307 

731.126 

1026.229021 

825.7709787 

516.9841525 

516.9841525 

595.5498639 

2190 

1423.5 

1451.97 

731.46 

1026.697833 

825.3021669 

517.2203262 

517.2203262 

595.3837004 

2191 

1424.15 

1452.633 

731.794 

1027.166645 

824.8333551 

517.4564998 

517.4564998 

595.2184163 

2192 

1424.8 

1453.296 

732.128 

1027.635457 

824.3645433 

517.6926735 

517.6926735 

595.0540126 

2193 

1425.45 

1453.959 

732.462 

1028.104268 

823.8957315 

517.9288472 

517.9288472 

594.8904898 

2194 

1426.1 

1454.622 

732.796 

1028.57308 

823.4269197 

518.1650208 

518.1650208 

594.7278487 

2195 

1426.75 

1455.285 

733.13 

1029.041892 

822.9581079 

518.4011945 

518.4011945 

594.5660901 

2196 

1427.4 

1455.948 

733.464 

1029.510704 

822.4892961 

518.6373682 

518.6373682 

594.4052147 

2197 

1428.05 

1456.611 

733.798 

1029.979516 

822.0204843 

518.8735418 

518.8735418 

594.2452232 

2198 

1428.7 

1457.274 

734.132 

1030.448327 

821.5516726 

519.1097155 

519.1097155 

594.0861162 

2199 

1429.35 

1457.937 

734.466 

1030.917139 

821.0828608 

519.3458892 

519.3458892 

593.9278946 

2200 

1430 

1458.6 

734.8 

1031.385951 

820.614049 

519.5820628 

519.5820628 

593.770559 

2201 

1430.65 

1459.263 

735.134 

1031.854763 

820.1452372 

519.8182365 

519.8182365 

593.6141101 

2202 

1431.3 

1459.926 

735.468 

1032.323575 

819.6764254 

520.0544101 

520.0544101 

593.4585486 

2203 

1431.95 

1460.589 

735.802 

1032.792386 

819.2076136 

520.2905838 

520.2905838 

593.3038752 

2204 

1432.6 

1461.252 

736.136 

1033.261198 

818.7388018 

520.5267575 

520.5267575 

593.1500907 

2205 

1433.25 

1461.915 

736.47 

1033.73001 

818.26999 

520.7629311 

520.7629311 

592.9971957 

2206 

1433.9 

1462.578 

736.804 

1034.198822 

817.8011782 

520.9991048 

520.9991048 

592.8451908 

2207 

1434.55 

1463.241 

737.138 

1034.667634 

817.3323664 

521.2352785 

521.2352785 

592.6940769 

2208 

1435.2 

1463.904 

737.472 

1035.136445 

816.8635546 

521.4714521 

521.4714521 

592.5438545 

2209 

1435.85 

1464.567 

737.806 

1035.605257 

816.3947428 

521.7076258 

521.7076258 

592.3945244 

2210 

1436.5 

1465.23 

738.14 

1036.074069 

815.925931 

521.9437995 

521.9437995 

592.2460871 

2211 

1437.15 

1465.893 

738.474 

1036.542881 

815.4571192 

522.1799731 

522.1799731 

592.0985435 

2212 

1437.8 

1466.556 

738.808 

1037.011693 

814.9883074 

522.4161468 

522.4161468 

591.9518941 

2213 

1438.45 

1467.219 

739.142 

1037.480504 

814.5194956 

522.6523205 

522.6523205 

591.8061396 

2214 

1439.1 

1467.882 

739.476 

1037.949316 

814.0506838 

522.8884941 

522.8884941 

591.6612807 

2215 

1439.75 

1468.545 

739.81 

1038.418128 

813.581872 

523.1246678 

523.1246678 

591.5173181 

2216 

1440.4 

1469.208 

740.144 

1038.88694 

813.1130602 

523.3608415 

523.3608415 

591.3742523 

2217 

1441.05 

1469.871 

740.478 

1039.355752 

812.6442484 

523.5970151 

523.5970151 

591.2320841 

2218 

1441.7 

1470.534 

740.812 

1039.824563 

812.1754366 

523.8331888 

523.8331888 

591.0908141 

2219 

1442.35 

1471.197 

741.146 

1040.293375 

811.7066248 

524.0693624 

524.0693624 

590.9504429 

2220 

1443 

1471.86 

741.48 

1040.762187 

811.237813 

524.3055361 

524.3055361 

590.8109712 

2221 

1443.65 

1472.523 

741.814 

1041.230999 

810.7690012 

524.5417098 

524.5417098 

590.6723997 

2222 

1444.3 

1473.186 

742.148 

1041.699811 

810.3001895 

524.7778834 

524.7778834 

590.5347288 

2223 

1444.95 

1473.849 

742.482 

1042.168622 

809.8313777 

525.0140571 

525.0140571 

590.3979594 

2224 

1445.6 

1474.512 

742.816 

1042.637434 

809.3625659 

525.2502308 

525.2502308 

590.2620919 

2225 

1446.25 

1475.175 

743.15 

1043.106246 

808.8937541 

525.4864044 

525.4864044 

590.1271271 

2226 

1446.9 

1475.838 

743.484 

1043.575058 

808.4249423 

525.7225781 

525.7225781 

589.9930655 

2227 

1447.55 

1476.501 

743.818 

1044.04387 

807.9561305 

525.9587518 

525.9587518 

589.8599078 

2228 

1448.2 

1477.164 

744.152 

1044.512681 

807.4873187 

526.1949254 

526.1949254 

589.7276546 

2229 

1448.85 

1477.827 

744.486 

1044.981493 

807.0185069 

526.4310991 

526.4310991 

589.5963064 

2230 

1449.5 

1478.49 

744.82 

1045.450305 

806.5496951 

526.6672728 

526.6672728 

589.465864 

2231 

1450.15 

1479.153 

745.154 

1045.919117 

806.0808833 

526.9034464 

526.9034464 

589.3363278 

2232 

1450.8 

1479.816 

745.488 

1046.387929 

805.6120715 

527.1396201 

527.1396201 

589.2076985 

2233 

1451.45 

1480.479 

745.822 

1046.85674 

805.1432597 

527.3757938 

527.3757938 

589.0799767 

2234 

1452.1 

1481.142 

746.156 

1047.325552 

804.6744479 

527.6119674 

527.6119674 

588.953163 

2235 

1452.75 

1481.805 

746.49 

1047.794364 

804.2056361 

527.8481411 

527.8481411 

588.8272579 

2236 

1453.4 

1482.468 

746.824 

1048.263176 

803.7368243 

528.0843148 

528.0843148 

588.7022621 

2237 

1454.05 

1483.131 

747.158 

1048.731987 

803.2680125 

528.3204884 

528.3204884 

588.5781761 

2238 

1454.7 

1483.794 

747.492 

1049.200799 

802.7992007 

528.5566621 

528.5566621 

588.4550005 
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